Europaisches 
Patentamt 



European 
Patent Office 



PCUEP 0 2 /1 40 02 



Office eurq 
des brevets 



RECD 1 3 FEB 2003 

~MPO I PCT 

Bescheinigung Certificate Attestation 



Die angehefteten Unterla- 
gen stimmen mit der 
ursprQnglich eingereichten 
Fassung der auf dem nSlch- 
sten Blatt bezeichneten 
europaischen Patentanmel- 
dung Qberein. 



The attached documents 
are exact copies of the 
European patent application 
described on the following 
page, as originally filed. 



Les documents fixes a 
cette attestation sont 
conformes a la version 
initialement deposee de 
la demande de brevet 
europeen specifiee a la 
page suivante. 



Patentanmeldung Nr. Patent application No- Demande de brevet n° 

02001252.2 



PRIORITY DOCUMENT 

SUBMITTED OR TRANSMITTED IN 
COMPLIANCE WITH 
RULE 17.1(a) OR (b) 



Der President des Europaischen Patentamts; 
Im Auftrag 

For the President of the European Patent Office 

Le President de I'Office europeen des brevets 
p.o. 



RCvan Dijk 



EP02/14002 



Europaisches Europeaj^^ Office eu rope en 

des brevets 



• Europaisches turopeai^ 
Patentamt Patent 



Anmeldung Nr: , 

Application no.: 02001252.2 
Demande no: 



Anmeldetag: 

Date of filing: 17.01.02 
Date de depot: 



Anmel der/Appl 1 cant( s)/Demandeur( s) : 

Honda R&D Europe (Deutschland). GmbH 
Carl-Legien-Strasse 30 
63073 Offenbach/Main 
ALLEMAGNE 



Bezeichnung der Erf indung/Titl e of the invention/Titre de 1 1 invention: 
(Falls die Bezeichnung der Erfindung nicht angegeben ist, siehe Beschreibung. 
If no title is shown please refer to the description. 
Si aucun titre n'est indique* se referer a la description.) 

Fuzzy preferences in mult i- objective optimization (MOO) 

In Anspruch genommene PrioriSt(en) / Priority( ies) claimed /Priori t£(s) 
revendiquge(s) 

Staat/Tag/Aktenzeichen/State/Date/File no. /Pays/Da te/Numero de dep6t: 



Internationale Patentkl as si fikati on/International Patent Classification/ 
Classification international e des brevets: 

B63B/ 

Am Anmeldetag benannte Vertragstaaten/Contracting states designated at date of 
filing/Etats contractants designees lors du depot: 

AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR 



02001252.2 

EPA/FPn/nFB Form 1014.2 - 01.2000 7001014 



2 



26229 EP 




• 



EPO- Munich 



73 



1Z Jan. 2002 



P26229EP 

Honda R&D (Europe) GmbH 

5 Fuzzy Preferences in Multi -Objective Optimization (MOO) 

The present invention relates to a method for the 
optimization of multi-objective problems using evolutionary 
algorithms, to the use of such a method for the optimization 
10 of aerodynamic or hydro dynamic bodies as well as to a 

computer software program product for implementing such a 
method. 

The background of the present invention is the field of 
15 evolution strategy. Therefore, with reference to Fig. 1, at 
first the known cycle of an evolutionary algorithm will be 
explained. 

In a step SI, the object parameters to be optimized are 
20 encoded in a string called 'individual 1 . A plurality of such 
individuals comprising the initial parent generation is then 
generated and the quality (fitness) of each individual in the 
parent generation is evaluated. In a step S2, the parents are 
reproduced by applying genetic operators called mutation and 
25 recombination. Thus, a new generation is reproduced in step 

53, which is called the offspring generation. The quality of 
the offspring individuals is evaluated using a fitness 
function that is the objective of the optimization in step 

54. Finally, depending on the calculated quality value, step 
30 S5 selects, possibly stochastically, the best offspring 

individuals (survival of the fittest) which are used as 
parents for the next generation cycle if the termination 
condition in step S6 is not satisfied. 
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Before evaluating the quality of each individual, decoding 
may be needed depending on the encoding scheme used in the 
evolutionary algorithm- It should be noted that the steps S2, 
S3, S4, S5 and S6 are cyclically repeated until the condition 
5 for termination of the optimization in step S6 is satisfied. 

The algorithm of this evolutionary optimization can be 
expressed by the following pseudo-code: 



10 



15 



20 



t := 0 

encode and initialize P(0) 
decode and evaluate P(0) 
do 

recombine P(t) 
mutate P(t) 
decode P(t) 
evaluate P(t) 
P(t+1) := select P(t) 
encode P(t+1) 
t := t + 1 
until terminate 



Thereby, 



25 P(0) denotes the initial population size (t = 0), 

P(t) denotes the offspring population size in the t-th 

successor generation (t > 0), 
t is the index for the generation number (t e © 0 ) . 



30 Such evolutionary algorithms are known to be robust 
optimizers that are well-suited for discontinuous and 
multi-modal objective functions. Therefore, evolutionary 
algorithms have successfully been applied e.g. to mechanical 
and aerodynamic optimization problems, -including preliminary 
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turbine design, turbine blade design, multi-disciplinary 
rotor blade design, multi-disciplinary wing platform design 
and a military airframe preliminary design. 

5 For example, details on evolutionary algorithms can be found 
in "Evolutionary Algorithms in Engineering Applications" 
(Springer-Verlag, 1997) by Dasgupta et al., and "Evolutionary 
Algorithms in Engineering and Computer Science" (John Wiley 
and Sons, 1999) by Miettinnen et al. 

10 

In the framework of the present invention, the evolutionary 
algorithms are applied to the simultaneous optimization of 
multiple objectives, which is a typical feature of practical 
engineering and design problems. The principle of multi- 

15 criterion optimization differs from that in a single-objec- 
tive optimization. In single-objective optimization, the 
object is to find the best design solution, which corresponds 
to the minimum or maximum value of the objective function. On 
the contrary, in a multi-criterion optimization with 

20 conflicting objectives, there is no single optimal solution. 
The interaction among different objectives gives rise to a 
set of compromise solutions known as the Pareto-optimal 
solutions. A definition of 'Pareto-optimal' and 'Pareto 
front' can be found in "Multi-Objective Evolutionary 

25 Algorithms: Analyzing the State of the Art" (Evolutionary 

Computation, 8(2), pp. 125-147, 2000) by D.A. Van Veldheizen 
and G. B. Lamont. 

Since none of these Pareto-optimal solutions can be 
30 identified as better than others without any further 

consideration, the object in a multi-criterion optimization 
is to find as many Pareto-optimal solutions as possible. Once 
such solutions are found, it usually requires a higher-level 
decisionmaking with other considerations to choose one of 
35 them for implementation. 
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There axe two objective's in a multi-criterion optimization: 

(i) finding solutions close to the true Pareto-optimal 
solutions, and 

(ii) finding solutions that are widely different from each 
other. 

The first task is desired to satisfy optimality conditions in 
the obtained solutions* The second task is desired to have no 
bias towards any particular objective function. 

In dealing with multi-criterion optimization problems, 
classical search and optimization methods are not efficient, 
simply because 

- most of them cannot find multiple solutions in a single 
run, thereby requiring them to be applied as many times as 
the number of desired Pareto-optimal solutions, 

- multiple application of these methods do not guarantee 
finding widely different Pareto-optimal solutions, and 

- most of them cannot efficiently handle problems with 
discrete variables and problems having multiple optimal 
solutions . 

On the contrary, the studies on evolutionary search 
algorithms, over the past few years, have shown that these 
methods can efficiently be used to eliminate most of the 
difficulties of classical methods mentioned above. Since they 
use a population of solutions in their search, multiple 
Pareto-optimal solutions can, in principle, be found in one 
single run. The use of diversity-preserving mechanisms can be 
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m 

added to the evolutionary search algorithms to find widely 
different Pareto-optimal solutions. • 

A large number of evolutionary multi-objective algorithms. 
(EMOA) have been proposed. So far, there are three main 
approaches to evolutionary multi-objective optimization, 
namely, aggregation approaches, population-based non-Pareto 
approaches and Pareto-based. approaches. In the recent years, 
the Pareto-based approaches have been gaining increasing 
attention in the evolutionary computation community and 
several successful algorithms have been proposed. 
Unfortunately, the Pareto-based approaches are often very 
time-consuming. 



15 Despite their shortcomings, weighted aggregation approaches 
to multi-objective optimization according to the state of the 
art are very easy to implement and computationally efficient. 
Usually,- aggregation approaches can provide only one Pareto- 
solution if the weights are fixed using problem-specific 

io prior knowledge. However, it is also possible to find more 
than one Pareto solution using this method by changing the 
weights during optimization. The weights of the different 
objectives are encoded in the chromosome to obtain more than 
one Pareto solutions. Phenotypic fitness sharing is used to 

5 keep the diversity of the weight combinations and mating 
restrictions are required so that the algorithm can work 
properly. 

It has been found that the shortcomings of the conventional 
aggregation approach can be overcome by systematically 
changing the weights during optimization without any loss of 
simplicity and efficiency. Three methods have been proposed 
to change the weights during optimization to approximate the 
Pareto front. The randomly-weighted aggregation (RWA) method 
distributes the weights uniformly and randomly among the 
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individuals within the population and the weights are re- 
distributed in each generation. In contrast, -the dynamically- 
weighted aggregation (DMA) method changes the weights 
gradually when the evolution proceeds. If the Pareto-optimal 
front is concave, the bang-bang weighted aggregation (BWA) 
can also be used. In order to incorporate preferences, both 
RWA and DWA can be used. 

Randomly Weighted Aggregation 

in the framework of evolutionary optimization it is natural 
to take advantage of the population for obtaining multiple 
Pareto-optimal solutions in one run of the optimization. On 
the assumption that the i-th individual in the population has 
its own weight combination (wl(t), w 2 J (t)) in generation t, the 
evolutionary algorithm will be able to find different Pareto- 
optimal solutions. To realize this, it can be found that the 
weight combinations need to be distributed uniformly and 
randomly among the individuals, and a re-distribution is 
necessary in each generation: 

i/vk rdm ( p ) 

wi(t) = 1.0 - wt(t), 



wherein 



i denotes the i-th individual in the 

population (i = 1, 2,..., P) , 
P is the population size (P e ©), and 
t is the index for the generation number (t e ©o) . 

The function rdm (p) generates a uniformly distributed random 
number between 0 and P. In this way, a uniformly distributed 
random weight combination w 2 ) among the individuals can 
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• 



be obtained, where 0 ^ w[ , vr\ < 1 and ^ + ^ 2=5 1 • In this 
context, it should be noted that the weight combinations are 
regenerated in every generation* 

5 Dynamic Weighted Aggregation 

In the dynamicallyrweighted aggregation (DWA) approach, all 
individuals have the same weight combination, which is 
changed gradually generation by generation. Once the 

10 individuals reach any point on the Pare to front, the slow 
change of the weights will force the individuals to keep 
moving gradually along the Pareto front if the Pareto front 
is convex. If the Pareto front is concave, the individuals 
will still traverse along the Pareto front, however, in a 

15 different fashion. The change of the weights can be realized 
as follows : 



20 

where t is the number of generation. Here the sine function 
is used simply because it is a plain periodical function 

between 0 and 1. In this case, the weights ^(t) and w 2 (t) 
will change from 0 to 1 periodically from generation to 
25 generation. The change frequency can be adjusted by F. The 
frequency should not be too high so that the algorithm is 
able to converge to a solution on the Pareto front. On the 
other hand, it seems reasonable to let the weight change from 
0 to 1 at least twice during the whole optimization. 

30 

In the above methods, it is assumed that all objectives are 
of the same importance. In this case, weights are changed 
between [0,1] in RWA and DWA to achieve all Pareto-optimal 
solutions. However, in many real-world applications, 



w i(t) = | sin (2 nt/F) | , 
w 2 (t) = 1.0 - ^(t). 



P 26229 EP 



different objectives may have different importance. Thus, the 
goal is not to get the whole Pareto front, but only the 
desired part of the Pareto front. The importance of each 
objective is usually specified by the human user in term of 
5 preferences. For example , for a two-objective problem, the 
user may believe that one objective is more important than 
the other. To achieve the desired Pareto-optimal solutions, 
preferences need to be incorporated into multiobjective 
optimization. Instead of changing the weights between [0,1], 
10 they are changed between [v/ ttin 9 w max ] , where 0 <, vT n < vf" ax <> 1, 
are defined by the preferences . Usually, the preferences can 
be incorporated before, during or after optimization. In this 
invention, preference incorporation before optimization is 
concerned. 

15 

As discussed in "Use of Preferences for GA-based Multi- 
Objective Optimization" (Proceedings ■ of 1999 Genetic and 
Evolutionary Computation Conference, pp. 1504-1510, 1999) by 
Cvetkovic et al., the incorporation of fuzzy preferences 
20 before optimization can be realized in two ways: 

« 

- Weighted Sum: Use of the preferences as a priori knowledge 
to determine the weight for each objective, then direct 
application of the weights to sum up the objectives to a 

25 scalar. In this case, only one solution will be obtained. 

- Weighted Pareto Method: The non-fuzzy weight is used to 
define a weighted Pareto non-dominance: 

1 * 

30 U > w V if and only if — J) w ± ljp if vj £ 1 

k i = i 



with the utility sets 



25229 EP 



U := {u d | i = 1, 2, 3, ... , k) for Ui e [0, 1] and 
V := {vj | i = 1, 2, 3, ... , A:} for v ± e [0, 1] , 



where 



_ / \ f 1 for > v. k 

^ vj) = (ofor U ;<,; and s^ -i. 

A general procedure for applying fuzzy preferences to multi- 
objective optimization is illustrated in Fig. 2. it can be 
seen that before the preferences can be applied in MOO, they 
have to be converted into crisp weights first. The procedure 
of conversion is described as follows: 

Given L experts (with the indices m = 1,2,... ,L) and their 
preference relation g", where P" is a (kxk) -matrix with Pij 
denoting the linguistic preference of the objective 0i over 
the objective oj (with the indices i,j = 1,2,...,*). Then, 
based on the group decision-making method, they can be 
combined into a single collective preference g>. Each element 
of said preference matrix p° is defined by one of the 
following linguistic terms: 



"much more important " (MMI) , 
"more important " (MI) , 
"equally important" (EI), 
"less important" (LI), and 
"much less important" (MLI) . 



For the sake of simplicity, the superscript c indicating the 
collective preference is omitted in the following text. 
Before converting the linguistic terms into real-valued 
weights, they should at first be converted into numeric 
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preferences. To this end, it is necessary to use the 
following evaluations, to replace the linguistic preferences 
p l3 in the preference matrix, as indicated in "Use of 
Preferences for GA-based Multi-Objective Optimization" 
(Proceedings of 1999 Genetic and Evolutionary Computation 
Conference, pp. 1504-1510) by Cvetkovic et al. 

a is much less important than b =>. Pu = a, Pji - P, 
a is less important than b => = Y' = 5 ' 

a is egually important as b => Pij = e, Pji = e. 

The value of the parameters needs to be assigned by the 
decision-making and the following conditions should be 
satisfied in order not to lose the interpretability of the 
linguistic terms: 

a < Y < e = °* 5 < 5 < P, 
a+P = l= Y + 8- 

Consider an MOO problem with six objectives o 2 , . . . , o 6 } as 
used in "Use of Preferences for GA-based Multi-Objective 
Optimization" (Proceedings of 1999 Genetic and Evolutionary 
Computation Conference, pp. 1504-1510) by Cvetkovic et al. 
Suppose that among these six objectives o* and o 2 , o 3 and o 4 
are equally important. Thus, there are have four classes of 
objectives : 

ci {o 1/ o 2 }, c 2 := {o 3 ,o 4 }, c 3 := {o 5 } and c 4 :» {o 6 }. 
Besides, there are the following preference relations: 



Ci is much more important than c 2 ; 
Ci is more important than c 3 ; 
c 4 is more important than ci; 
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c 3 is much more important than c 2 . 

From these preferences, it is easy to get the following 
preference matrix: 



P = 



( EI MMI MI LI ^ 

MLI EI ML I ML I 

LI MMI EI LI 

^ MI MMI MI EI j 



From the above fuzzy preference matrix, the following real- 
valued preference relation matrix £_are obtained: 



R = 



f e 0 5 y N 

a s a a 

Y 0 6 y 

18 P 5 e J 



Based on this relation matrix, the weight for each objective 
can be obtained by: 



w( 0j ) = 



25-1 s{o irS ) 



with 



For the above example, this results in 



w, = w 2 = 



2 - a 
8 + 2a 
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3a 



w 5 



8 + 2a 
1 - a + 2y 



w, 



8 + 2a 

3 - a - 2y 
6 8 + 2a 



, and 



Since a and y can vary between 0 and 0.5, one needs to 
heuristically specify a value for a and y (recall that a < y) 
to convert the fuzzy preferences into a single-valued weight 
combination, which can then be applied to a conventional 
weighted aggregation to achieve one solution. 

in order to convert fuzzy preferences into one weight 
combination, it is necessary to specify a value for a and y. 
On the one hand, there are no explicit rules on how to 
specify these parameters, on the other hand, a lot of 
information will be lost in this process. 

in view of this disadvantage it is the object of the present 
invention to improve the use of fuzzy preferences for multi- 
objective optimization. 

This object is achieved by means of the features of the 
independent claims. The dependent claims develop further the 
central idea of the present invention. 

According to the main aspect of the invention, e.g. fuzzy 
preferences are converted into a weight combination with each 
weight being described by an interval instead of a single 
value . 

Further objects, advantages and features of the invention 
will become evident for the man skilled in the art when 
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reading the following detailed description of the invention 
and by reference to the figures of the enclosed drawings. 



change of parameter (a) , respectively, and 
Figs. 4a, 4b show the change of weights ( w 3 and w 4 ) with 



5 According to the underlying invention, linguistic fuzzy 

preferences can be converted into a weight combination with 
each weight being described by an interval. 

Figs. 3a, 3b, 4a, 4b show how the value of the parameters 
10 affects that of the weights. It can be seen from these 

figures that the weights vary a lot when the parameters (a, y 
) change in the allowed range. Thus, each weight obtained 
from the fuzzy preferences is an interval on [0,1]. Very 
interestingly, a weight combination in interval values can 
15 nicely be incorporated into a multi-objective optimization 
with the help of the RWA and DWA, which is explained e.g. in 
"Evolutionary Weighted Aggregation: Why does it Work and 
How?" (in: Proceedings of Genetic and Evolutionary 
Computation Conference, pp. 1042-1049, 2001) by Jin et al. 

20 

On the assumption that the maximal and minimal value of a 
weight are w max and w min when the parameters change, the 
weights are changed during an optimization algorithm in the 
following form, which is extended from RWA: 



Figs. 3a, 3b 



Fig. 1 
Fig. 2 



shows a cycle of an evolution strategy, 

shows schematically a procedure to apply fuzzy 

preferences in MOO, 

show the change of weights (wi and w 2 ) with the 



the change of parameters (a and y) , 
respectively. 



25 
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wi(t) = < 




rdm (p) 
P 



where t is the generation index. Similarly, by extending the 
DWA, the weights can also be changed in the following form to 
5 find out the preferred Pareto solutions: 



where t is the generation index. In this way, the 
10 evolutionary algorithm is able to provide a set of Pareto 
solutions that are reflected by the fuzzy preferences. 
However, it is recalled that DWA is not able to control the 
movement of the individuals if the Pareto front is concave, 
therefore, fuzzy preferences incorporation into MOO using DWA 
15 is applicable to convex Pareto fronts only, whereas the RWA 
method is applicable to both convex and concave fronts. 

To illustrate the underlying invention, some examples on two- 
objective optimization using the RWA are presented in the 
20 following. In the simulations, two different fuzzy 
preferences are considered: 



wt(t) = w; 



+ (w™* - ■ I sin (2 nt/F) | , 



1. Objective 1 is more important than objective 2; 

2. Objective 1 is less important than objective 2. 



25 



For the first preference, one obtains the following 
preference matrix: 




30 



with 0.5 < 5 < 1 and 0 < y < 0.5. Therefore, the weights for the 
two objectives using the RWA method are: 
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wj(t)= 0.5 + Q.5. rdm( ?\ 

P 

w 2 J (t) s l.o - ^(t). 

5 Similarly, the following weights are obtained for the second 
preference: 



10 



20 



25 



30 



w((t) = 0 + 0.5 



rdm (p) 



P 

w 2 J (t) = 1.0 - wi(t). 



To summarize, the invention proposes a method to obtain the 
Pare to-optimal solutions that are specified by human 
preferences. The main idea is to convert the fuzzy 
preferences into interval-based weights. With the help of the 
15 RWA and DWA, it is shown to be successful to find the 
preferred solutions on two test functions with a convex 
Pareto front. Compared to the method described in "Use of 
Preferences for GA-based Multi-Objective Optimization" 
(Proceedings of 1999 Genetic and Evolutionary Computation 
Conference, pp. 1504-1510, 1999) by Cvetkovic et al., the 
method according to the invention is able to find a number of 
solutions instead of only one, given a set of fuzzy 
preferences over different objectives. This is consistent 
with the motivation of fuzzy logic. 



Many technical, industrial and business applications are 
possible for evolutionary optimization. Examples for 
applications can be found e.g. in "Evolutionary Algorithms in 
Engineering Applications" (Springer-Verlag, 1997) by Dasgupta 
et al . , and "Evolutionary Algorithms in Engineering and 
Computer Science" {John Wiley and Sons, 1999) by Miettinnen 
et al. 
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1. A method for the optimization of multi-objective problems 
using evolutionary algorithms, the method comprising the 
following steps: 

- setting up an initial population as parents (SI), 

- reproducing the parents to create a plurality of offspring 
individuals (S2, S3), 

- evaluating the quality of the offspring individuals by 
means of a fitness function (S4), wherein the fitness 
function is composed of the sum of weighted sub- functions 
that represent an objective, 

- selecting the offspring (s) having the highest evaluated 
quality value as parents for the next evolution cycle (S5) , 

characterized in that 

during the optimization the weights for the sub-functions are 
changed dynamically respectively within a predefined interval 
for every weight. 

2. Method according to claim 1, 
characterized in that 

human preferences represented by linguistic preference 
relations are converted into parameterized, real-valued 
preferences relations to generate the intervals defining the 
allowed range of weight changes. 

3. Method according to claim 2, 
characterized in that 

the parameterized preference relationsare converted into 
real-valued intervals by letting the parameters take all the 
allowed value instead of assigning one specific value to each 
parameter. 
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4. Method according to anyone of the preceding claims, 
characterized in thai: 

the weights for the different objectives are randomly re- 
distributed within the defined intervals among the different 
offspring individuals in each generation. 

5. Method according to anyone of claims 1 to 3, 
characterized in that 

the weights for the different objectives are changed 
gradually within the defined intervals with the proceeding of 
optimization. 

6. Method according to claim 5, 
characterized in that 

the weights are changed within the intervals according to a 
periodic function. 

7. Method according to claim 5 or 6, 
characterized in that 

each offspring has the same weight in the same generation. 

8. Method according to anyone of claims 5 to 7, 
characterized in that 

the periodic change has the shape of a sine function applied 
on the generation number. 

9. computer software program product, 
characterized in that 

it implements a method according to anyone of the preceding 
claims when run on a computing device. 

10. Use of a method according to anyone of claims 1 to 8 for 
the optimization of aerodynamic or hydrodynamic bodies, 
wherein different objectives have to be taken into account, 
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e.g. pressure loss and outlet angle calculated by a Navier- 
Stokes solver and geometric constraints. 
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Abstract 

A method to obtain the Pareto solutions that are specified by 
human preferences is suggested. The main idea is to convert 
the f U22y preferences into interval-based weights. With the 
help of the dynamically-weighted aggregation method, it is 
shown to be successful to find the preferred solutions on two 
test functions with a convex Pareto front. Compared to the 
method described in "Use of Preferences for GA-based Multi- 
Objective Optimization" (Proceedings of 1999 Genetic and 
Evolutionary Computation Conference, pp. 1504-1510, 19 99 ) by 
Cvetkovic et al., the method according to the invention is 
able to find a number of solutions instead of only one, given 
a set of fuzzy preferences over different objectives. This is 
consistent with the motivation of fuzzy logic. 

Fig. 2 
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Algorithm 
t:=0; 

encode and initialize P(0) 

decode and evaluate P(0) 
do 

recombine P(t) 
mutate P(t) 

decode P(t) 

evaluate P(t) 

P(t+1) = select (P(t) 
encode P(t+1) 
t:=t+1 
until terminate 
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